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Abstract: 

The Science Data Management and Science Payload Operations subpanel reports 
from the NASA Conference on Scientific Data Compression (Snowbird, Utah in 1988) 
indicate the need for both lossless and lossy image data compression systems. The 
ranges developed by the subpanel suggest ratios of 2:1 to 4:1 for lossless coding and 
2:1 to 6:1 for lossy predictive coding. For the NASA Freedom Science Video 
Processing Facility it would be highly desirable to implement one baseline 
compression system which would meet both of these criteria. This paper presents 
such a system utilizing an LZW hybrid coding scheme which is adaptable to either 
type of compression. Simulation results are presented with the hybrid LZW algorithm 
operating in each of its modes. 


Introduction: 

LZW lossless coding 1,2 is a completely reversible process; the encoding/decoding 
operations preserve all of the information contained in the input data sequence. This 
technique may be used on image data, computer files, or telemetered data. The 
hybrid system presented in this paper has the ability to compress image data in either 
a lossless or lossy mode, trading off data quality for data volume. It does this by 
means of an adaptive DPCM loop, which decorrelates the input image into symbols, 
before encoding with the LZW algorithm. The DPCM output symbols may be 
uniquely represented (lossless mode) or quantized (lossy mode.) 

In addition, a mechanism is provided for the compression of non-video (telemetered) 
data. The mode of operation may be selected through the command and control 
system. 


Decorrelatinq the input image (the decorrelation circuit): 

Let Sj represent the value of the i* h element of an image vector S, being clocked out 
of a camera. The value of the previous pixel is thus Sj.^. The "error" vector 
(sometimes called the difference signal) E, is defined as Ej=Sj-Sj_^ . A complete, 
alternate representation of S is the first pixel, Sq followed by the vector of error 
values, E. This representation contains enough information to reconstruct S (since 
Sj = Sj_i + Ej.) This idea forms the basis of predictive coding theory 3 . 
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The compression ratio for lossless coding is bounded by the entropy of the input data. 
Since adjacent pixels in an image tend to be highly correlated, the resulting entropy 
for the vector E is much lower than that of the original vector S. Fig. 1 shows a 
reconnaissance image (S) and its histogram, and Fig. 2 shows the resulting 
decorrelated image (E) and its histogram. In Fig. 2 all values of E have been made 
positive by adding an offset. Thus, Ej=0 is displayed at the middle of the graph. 



Fig 1-1 (Recce, original) 



Fig 2-1 (Recce. Decorrelated) 


Refutation 



Fig 1-2 (Histogram of Recce, image) 
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Fig 2-2 (Histogram of Decorrelated image) 


Uniquely representing each error value, as in Fig. 2, requires 2 n+1 bits, where n is 
the total number of bits per pixel in S. In this way, all information is preserved and S 
can be completely reconstructed; such a representation is used in the lossless mode 
of the hybrid LZW compressor. 
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Alternatively one can choose to quantize the error signal: 


and then 



E; + .5 


A 


where A = the current bin width of the quantizer 




If A > 2, then E can be represented with fewer bits, but quantization error is 
introduced into the image; this technique is used in the lossy mode of the compressor. 
The case A=1 is referred to as linear quantizing, and represents the lossless mode. 

It is possible to switch between the lossy and lossless modes of operation by 
determining the representation to use to describe E: either uniquely representing or 

quantizing each Ej (see Fig. 3.) For the remainder of this paper, the error Ej' and 

error vector E( will be used to represent output from the quantizer in Fig. 3. 

Lossless - Linear Quantizer 
Lossy - Non-Uniform Quantizer 



Encoding the Error: 

Once the quantized error vector E' is obtained, it is encoded with the LZW algorithm, 

thus preserving all information contained in E'. The LZW algorithm is a good choice 
since it approaches the lower bounds of compression ratios attainable by block-to- 
variable and variable-to-block codes designed to match specific source data. Since 
the LZW routine automatically adapts to changes in the source data no a priori 

information about E' is required. 
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System block diagram: 

Fig. 4 shows the block diagram for the compression system. The image S (in Fig. 4, 
shown coming from an experiment occurring in the Space Station) passes through a 

subtractor which forms E. Then, depending on the mode selected, Ej' is formed by 

quantizing or singularly representing (linear quantizing) Ej. 

The "predictor" block in Fig. 4 is simply a function for improving the accuracy of the 
value Ej. Instead of representing Ej by Sj-Sj' ^, some other equation may be used 

which takes into account the correlation between vertically adjacent pixels in the 
image. S is now represented as a two dimensional array Sj j, where i and j have 

origin at 0 and are bounded by the maximum horizontal and vertical dimensions of the 
image. Determining good equations for Ej is the subject of many books and papers on 

predictive coding 4 . The equation used for the remainder of this paper is 

Ej = Sj - P(i,j) , 

where 


P(i,j) = 0.75*Sj'-, j - 0.5*Sj , _ 1 j _ 1 + 0.75*Sj / j _ 1 



Fig 4. Hybrid LZW system block diagram 
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After quantizing, the signal E' is fed into the LZW compressor which codes it without 
loss. The resulting symbols are placed into an elastic buffer (described later), and are 
finally output into a fixed channel (in Fig. 4, the TDRSS KSA channel.) 

The elastic buffer and bit-rate controller are shown as two separate blocks (in reality 
they are often merged.) The purpose of the bit-rate controller is to switch between 
lossless and lossy modes so that the output symbols from the LZW compressor are of 
constant rate (in bits/pixel) on average. The bit-rate controller does this by examining 
the current rate of compression and changing the current mode of operation (lossless 
or lossy), when necessary, to bring the rate into the desired range. 


Additional control is provided by resetting the LZW symbol table when compression 
falls below the channel output rate. In such a case, symbols are being generated too 
efficiently. By resetting the LZW table, we force the algorithm to begin learning the 
scene statistics anew. This results in a lower compression rate until the table fills up. 


Unfortunately, the rate out of the LZW encoder cannot be controlled at every instant. 
Thus, the elastic buffer is needed to hold several lines of image information in case of 
drastic changes in the scene statistics (which cause a large change in the 
instantaneous bit-rate.) In this way, constant output rate may be assured over the 
entire image, if not on a line by line basis. 


In addition to compressing image data, the system provides a path for non-image 
data. This ancillary information (such as data from experiments) is fed directly into the 
LZW compressor. 


Results: 

A variety of images were selected to examine the performance of the hybrid LZW 
compression system in each of its modes. Some results for the lossy mode (A=8) are 
shown in Fig. 5. Two of the images, (Docking Target and Satellite) contain 

significant amounts of tape noise. Lossless results are not shown since the original 
image is always equal to the reconstructed image. Tables 1 and 2 show 
compression of between 3.4 and 4.3 bits/pixel for the lossless mode, and 1.24 to 1.59 
bits/pixel in the lossy mode with A=8. The quantizer used for the lossy case is a non- 
uniform quantizer (Fig. 6.) For such a quantizer, the width of each bin increases as 

Ej ' increases, and the output of each bin is not its center, but rather its centroid. 
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Fig 5-5. Docking Target Image 


Fig 5-1. Satellite Image 


Fig 5-3. Satellite reconstructed with A =8 
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Fig 5-2. Histogram of Satellite 


Fig 5-4. Histogram of Fig 5-3 
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Lossless L Z Compression 
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Table 1 . Lossless Compression Results 
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Table 2. Lossy Compression Results 
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Fig 6. Non-uniform quantizer 





Future Plans: 

Current results from the hybrid LZW routine indicate that it is possible to satisfy both 
lossless and lossy requirements in a single system. In order to gain even greater 
compression ratios, several possible enhancements are currently being investigated. 

Improved control of the bit-rate out of the quantizer is being developed for the lossy 
case. Control is provided by modification of A on a line by line basis, that is, the 
current bit-rate is examined at the end of every line, and A is adjusted (if necessary) 
to raise or lower the output symbols to the desired rate. 

Further optimization of the non-uniform quantizer is possible. A constrained loss 
quantizer should be implemented. This quantizer uses a A=1 (linear quantizer) for low 
values of Ej, and uses larger values of A as the values of Ej increase. 

Finally, use of the Discrete Cosine Transform to decorrelate S instead of a DPCM 
predictor is being considered. LZW compression ratios of 16:1 have been realized 
for DCT coefficients. 


Summary: 

A hybrid LZW compression system has been presented which satisfies NASA 
requirements for both lossy and lossless compression. The system has been 
simulated on a computer, and has produced good quality output images at rates as 
low as 1.24 bits/pixel. The system appears to have applicability for spacecraft and 
reconnaissance imagery. 
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